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JOINT BIT RATE CONTROL 



' The present invention relates to an audio-visual content transmission 

system, and to a method for use in the oontrol of such. ra " sm '^on 

«*mT?Z r P0Sa ! h ° me aUd,OViSUal (W) 

system. It ,s apprecated tha, there are installation and cost benefits «o be 

d is H SyStemS WNCh haVe 3 ^ <° «X 

debuted around a home by wireless links. However, the provision of Z 

wireless W, poses a number of technical p rob ,ems, som of wT h \he 
present invention seeks to address. 

Background information on joint bit-rate control can be found from 
M ,,-pregram video data compression-, by G.d.Keesman, o, Eindhoven 
JESST"* Lab0ratorieS ' Th - S Unlversitei, Oefit - ,S BN £ 

According to a first aspect of the present invention, there is provided 
apparatus for distribufing audio-visua, content over at least two channTt 

Z ^ bei " 9 UnPredfc,abte ' ,hS aP ~ ~« a code and a 

date b uffer for each ohanneli and a oontro|ter 9 and 

data wh,ch ,s deemed not to have been received correctly the apparatus 
compdsing a join, bit-rate controller arranged to control each ftee " 
P-de data a, a rate which is deaden, a, leas, in par, on a date pS^J 
rate and on a date transmission rate. production 
Each coder may be an encoder or a transcoder, depending on the 

ZZIT T ' is desisned ,0 process - The ^ 2 

date products and transmission rates is one which operates as a function of 
- amount of date awaiting transmission . The ^ Qf ^ "~ 
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transmission may be measured direcfly. or inferred from other measured 
parameters, sucb as the data transmission rate and the data produotion rate 

Th,s can provide a flexible system whioh modifies its operatino 
parameters automation depending on the operating environment. t a o 
3 praxes an efficient use of a buffertng deiay whioh. in the embodilnj 
a^usts the quality of coding to su« the buffer condition. This enable 

channel, and is susceptible to the support of further channels 

o data at G °°? 'T"^ °" bS ° bteined by COn ' roll,n 9 the '0 provide 

date a, a rate wh,ch is dependent in pad on the dffferenoe between the amo n 

it, P :::r nsm,ss,on and a ^ — ^ * . 

The joint bit-rate controller preferably Is arranged to apply . mnW 

Z 3 T' ^ ° f 8aCh Wh ' Ch determi - di « uaC 
encod,ng used, affhpugh it may instead be arranged to apply a control signa 

to a contra, « of each coder which determines direcuy flJoutpu, date "I' 

^zz':^z: obtained * ,he — — * - — 

m*, h^" 19 '° 3 SeC ° nd aSP6Ct ° f *" ia provided a 

method o, debuting audio visual content over a, leas, two channels the 1 
oh n ne rate be|ng unpredictabtei ^ ^ ^ •-«- 

and a data buffer for each channel, controlling the transition o dateTr Z 

ave I COntro " in9 re,ranSmiSSi ° n ° f date "** * *«- -Ho 

IdersT T" 4,16 mS,h ° d — 9 ~ng each of he 

coders to prov,de data at a rate whioh is dependent a, leas, in part on . «£ 
product™ rate and on a date transmission rate. 

Embodiments of the present invention will now be described bv wav of 
example only, with referent t n th„ o- . ™ eo ' Dy wa y of 

y, n reterence to the accompanying drawings, of which- 

-em t r; e lc :: e ;:ira :r of a home av ~ — 
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system; 



Figure 2 shows an embodiment of certain components of the Figure 1 



stead ''J? 3 '" US,rateS ^ fU " neSS at a " * ncoder stati °" of Figure 2 in a 
steady state condition; and 

5 chan ?T 4 i " UStrateS fU " neSS a ' ^coder station soon after a 
channel-change condition. 

^ Referring to Figure 1, a house 10 is provided with first to fourth 
e ev,s,on sets 1, to 14, each se, having a respective remote con.ro, RC A 

16 wh,ch may be a safeilite dish, a convenhona, aerial, a cable TV source or 
an internet TV source to c„e some non-,im„ing examples. The ZZ Z in 
*■ exampto has four oufpu, channels, two of which are wired to the l a 
*e four* TV sets by respecrive co-axia, cables, and two of which a I 
through a radio transceiver 17. The second and «h W TV sets 12 13 ha^ 
ssooato toerew^h respective radio ,,nsceh,ers 13, 19 , each J ^ 
c^ble to oommunioate wKh toe gateway 1 5 via toe transceiver 17 The 
^ <~rs 18, tg can be referred to as ■thin dents', since ,hey do'o 
conta,n much processing .sources or other hardware, instead, a hard « 

srcw-1 m*„ h= , P rtaWe radio transceivers (not 

show. . may be arranged to receive further output channels of the gateway 15 
,~ gateway 15 may be constituted asa server, instead of an STB 

Th,s example relates to the case where the video source has analooue 
«***Bnab. rather than digitally encoded signals 8 

Components of the wireT^s channels are shown in Figure 2 The 

rr^rrr 2 t :;t each * ~ ~ 

- a ch , are ILL" ~ 
- ^ encooed s,gna,s then multiplexed together. This may be achieved by 
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separate audio and video encoders (not shown) in each channel. The 
encoding process results in the digital compression of the audio-visual signals. 

Outputs of the buffers 23-25 are connected to respective inputs of a 
scheduler 26, an output of which is connected to the transceiver 17. The 
5 encoders 20-22 are controlled by a joint bit-rate controller (JBRC) 27. The 
encoders 20-22 each code analogue input signals into MPEG-2. Each 
encoder 20-22 includes a quantisation step size control input. A signal applied 
to the input by the JBRC determines the quantisation step size, and thus the 
quality of encoding in the output signals. For this reason, it is termed the Q 
io input. The output bit rate is dependent on the complexity of the content and on 
the Q control input. Alternatively, quality control could be effected through the 
use of a different control input. 

The scheduler 26 operates according to a modified EDF (earliest 
deadline first) algorithm, which prioritises the transmission of data which is due 
15 for presentation earlier than other data. The transceivers 1 8, 1 9 each includes 
in series a respective buffer 28, 29 and a respective decoder 30, 31. A further 
transceiver 32 similarly includes a buffer 33 and a decoder in series. 

The radio transceiver 17 is operable to send radio data frames in 
packets at a single frequency, for example using 802.1 1a. Each data frame is 
20 directed to a certain one of the receivers 18, 19. 32. The receivers 18, 19, 32 
discard data frames which are not addressed to them. In general, the data 
frames each have the same duration. However, the number of data bits 
included in a data frame depends on the characteristics of the transmission 
path between the transmitter 17 and the relevant receiver 18, 19, 32. Where a 
25 transmission path has less favourable characteristics, fewer data bits are 
included in data frames transmitted over it, and vice versa. Accordingly, there 
may be different maximum transmission rates for the different receivers 18 19 
32. A receiver 18, 19, 32 that is more distant from the transmitter 17 is able to 
receive less bits per tim^ar.ce, since more bits in frames sent to it are used 
30 for error correction. 

The notification of data frames which have been received properly at 
the receivers 18, 19, 32 is made by way of a low bandwidth channel from the 
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relevant receiver to the transceiver 17. . Retransmission of data frames which 
« no, property received occurs in any suitable manner. This Jw ha d^h 

t:::z r rany remo,e *•* •* — - - 

suppiycabiing for instance ' * ^ ^ 

The maximum amount of buffering in the system is limited bv th» 
amount of memory and by a desire to ii m n ,„ V 

P-aying bacK at a iower spee Thl a ^ " ^ ^ 
! hnff • , S emb °diment utilises a 10 second 

isn air: fferin9 de,ay for a *— is ^ — - 

e gateway 15 and the corresponding buffer in the receiver 18 19 32 

Rgure 3 shows the transmit buffer status for video data generated bv 
the encoders for three separate analogue video sources le a IT. 
channels), and are labelled channels 1 2 anH " 
iNus.ra.es the buffer status a, «me "o The , t T * ^ n8UW 
to be decoded is termed ^1^^^^^ 
deadline «me for me date represented bvl the 
.=10, which corresponds to ZTZTLZ " *™ ^ 

the arcled positions. Data is consumed by the schedule 9« + 
=b y .e doffed veriioa, line. At any gJen ££££ ^ 

r : a r: f ::r of , one o,the buffers — = 

'o .he right of .he LtoW r " ^ ^ data ~«« 

«r io, iy, 32, with or without retransmission. 
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The system shown in Figure 3 is in a steady state since, at a given point 
in tame, all three encoders 20-22 produce data with equal deadline times (i e 
t=20). Here, the total end-to-end delay has reached the maximum delay for all 
three channels. This delay equals 10 seconds (the difference in time between 
t=10 and wo. The amount of data generated for the channels for a given 
deadline time is controlled by the JBRC 27. This determines the height of the 
curves in the future. 

In such steady state conditions, the JBRC 27 operates in a LOOSE 
mode. Here, the same control signal is applied to the Q input of each of the 
encoders 20-22, which results in equal quality encoding on each channel In 
LOOSE mode, the JBRC 27 effects control of the encoders 20-22 with the aim 
of achieving 20% of the buffer delay for each channel in the gateway 15 with 
the other 80% being held at the receiver 18, 19, 32. This buffering condition 
provides a good tolerance to channel degradation. Where the buffer delay 
totals ten seconds, the aim is to store two seconds (equating to 20% of the 
total) of data in the gateway 15. This is achieved by updating the Q control 
input once every second according to equation (1): 

Qnew = Qold -A (Dbuff - Dtarget) equation (1 } 

where Qnew is the next Q value, Qold is the existing value, Dbuff is the total 
amount of data in the gateway buffers 23-25 (in seconds) and Dtarget is the 
target buffer fullness (in seconds). A is a control parameter. Dtarget can be 
calculated as the target buffer fullness at the gateway multiplied by the number 
of active channels. 

Since equation (1) calculates the difference between the actual buffer 
fullness and the target buffer fullness, buffer fullness can instead be measured 
in terms of bytes, frames or any other suitable measure. In this case the 
target buffer fullness may need to be calculated using an estimate of the 
amount of data (or other measure) corresponding to the reproduction time 
target. 
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The value of A determines the reaction speed of the system to 
variations in buffer fullness. Variations can be caused by changes in the 
output channel rate (i.e. the throughput of data from the transmitter 17, taking 
into account retransmissions, and changes in the complexity of the content 
coded by the encoders 20-22. Since the control input affects the quality of 
encoding, and not the output bit rate, a higher complexity content on average 
would result in a higher average data rate. Due to equation (1), however the 
system will naturally tend towards the target buffer fullness even as operating 
conditions charge our time. Also, since the same Q control signal is applied to 
each of the encoders 20-22, the perceived picture quality at each of the 
receivers 18,19, 32 is optimised. 

The above description of Figure 3 relates to steady-state conditions i e 
when all of the receivers 18, 19, 32 have been receiving data for their 
respective selected television channel for a relatively long period of time The 
steady-state is upset when a user of the television 12, associated with the 
rece,ver 18, changes the source channel using the appropriate remote control 
RC. In response, the data buffers for the channel (i.e. at the gateway 15 and 
at the receiver 18) are emptied of data, and a different television channel is set 
up at the gateway . Immediately after the channel-change event, a minimal 
amount of buffering is set up in the system in order to allow the receiver 18 to 
start playback as soon as possible after the event. Figure 4 shows an example 
of the state of the transmit buffers shortly after a channel change event for 
channel 1, again at a time t=10s. As with Figure 3, the height of the line for 
channel 3 represents the tota. amount of data with a corresponding deadline in 
the transmit buffers 22, 23. 

As can be seen, there is now data in the transmit buffer 22 for which the 
deadline is very close to the current time (t=10s). The scheduler 26 first sends 
out all the channel 1 data close to t=10 before considering any channel 2 or 3 
data. This causes channel 1 to be allocated as much of the available channel 
bandwidth as required for a period of time, until the scheduler position moves 
such that the buffers for channel 2 or channel 3 contain data that has a 
deadline before the earliest deadline data for channel 1 . 
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For channel 1, the encoder 20 inserts data with a deadline that is still 
quite near to the current time. However, reduced speed playback is used at 
the receiver 18, which causes the insertion point for channel 1 to move 
gradually towards the insertion points for the other channels. Reduced speed 
playback allows the build-up of a buffering delay (i.e. an increase in the 
amount of data in terms of the playback time) between encoders and decoders 
whilst audio-visual data is being consumed. Eventually, the steady state as 
shown in Figure 3 is reached. A switch-on event is dealt with in substantially 
the same way, although of course it is not necessary to first empty the buffers. 
The fact that the buffer is distributed over the system also allows delay due to 
DSP constraints to occur without having a negative effect on content 
reproduction. 

Following a channel-change event, normally, the LOOSE control is 
maintained, with the new channel being coded with the uniform quality Q. If 
this results in the production of data at a greater rate than the transmission 
rate, the gateway buffer will become more full and Q will gradually be 
controlled to a lower point by Equation (1). Because the new channel has the 
highest priority in the scheduler, a change to a channel that has complex 
content results in more gateway buffering for the other channels (which 
already have sufficient data available in the receive buffers anyway), whereas 
all the data for the new channel will be sent out straight away. 

When a determination is made at the gateway 15 that the amount of 
data stored at the buffers in the receivers 18, 19, 32 is less than a threshold, 
for example 5 seconds per receiver, the JBRC 27 enters into a TIGHT mode' 
The determination may be made in any suitable way, for example by inferring 
the amount of data at the receivers 18, 19, 32 from the amount of data that is 
m the gateway buffers 23-25. This mode might be entered into if, for example, 
two or more channels are changed within a short time period. 

When operating in TIGHT mode, the control signal applied to the Q 
inputs of the encoders 20-22 is calculated in a different way. In TIGHT mode 
operation is more like that found in digital broadcasting, in which the output bit 
rate rather than the quality is the important parameter. The goal is control 
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each encoder 20-22 to provide data at a specified bit rate, which may be 
different for each encoder. A target bit rate is set for each encoder, and the 
JBRC 27 seeks to achieve that bit rate as accurately as possible. An 
explanation follows, to aid understanding 

The target bit rate depends on the complexity of the content. . 
In a simple embodiment, it is assumed that all the receivers 18, 19, 32 are at 
the same distance from the transmitter 17, equal maximum transmission data 
rates would be obtained. In TIGHT mode, a goal of the JBRC 27 is to limit the 
total amount of data produced by the encoders 20-22 so that data is 
transmitted by the transmitter 17 at a greater rate than it is produced by the 
encoders. 

This can be formalised as follows: 
Rtotal = Rest-A(Dbuff) equation (2) 

where A is a control parameter. 



20 



25 



30 



The rate of the channel at the time when the data that is currently being 
produced by the encoders 20-22 reaches the scheduler is not known because 
this time is in the future. Accordingly, a transmit channel rate Rest is 
estimated based on previous channel characteristics. This estimation may be 
made by calculating the average channel rate over the preceding ten minutes, 
and updating the estimation every minute. However, many other methods 
-0-jld be used instead. A total channel rate Rtotal is then calculated by 
subtracting from the estimated channel rate Rest a value that is proportional to 
the toiaJ amount of data in the transmit buffers Dbuff. Dbuff is the area below 
th* ^annel 3 line bounded by the scheduler position in Figure 3, and can be 
calculated in any convenient manner. 

First of all the picture quality Qi, is assumed to be related to the channel 
rate Ri and the complexity of the content Xi as follows: 



Qi = Ri/Xi 



Equation (3) 
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The manner in which the JBRC 27 operates to determine the complexity of the 
content of the channels is conventional. Since it is sought for the picture 
quality to be uniform over all channels: 

Qi = Q Equation (4) 

Q is a target quality, which is the same for all channels. Qi is the 
instantaneous quality control input for a channel. Since the actual complexity 
will differ from the estimated complexity, each of the Qi values is dynamically 
adjusted (and hence differs slightly from Q) by the JBRC 27 in order to achieve 
the target bit rate. The sum of the rates of the individual channels must equal 
the total rate: 

Sum(Ri) = Rtotal. Equation (5) 

Solving these equations yields the following for the channel rate Ri: 

Ri = Rtotal x (Xi/sum(Xi)) equation (6) 

And for the uniform target quality Q: 

Q = Ri/Xi = Rtotal/ Sum(Xi) Equation (7) 

Depending on the type of encoder used, control may be effected by application 
of a suitable control signal to a quantisation step size input, or other quality 
control input, or a bit rate input of the encoder 20-22. Here, sum(Xi) is the sum 
of the complexities of the different channels. 

Since the paths to the different receivers might be different, the amount 
of data transmittable in a data frame may differ accordingly. This is allowed • 
for by a more sophisticated embodiment as follows. Here, since the total 
amount of time for transmitting the data is limited, the trade-off in allocation 
bandwidth between the individual channels changes. As an illustration, a data 
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frame awarded to channel 1 for a near receiver might carry more data than if 
awarded to channel 2 for a more remote receiver. If the complexities of data 
for the channels 1 and 2 are equal, awarding the frame to channel 1 would 
yield the highest increase in picture quality. . Accordingly, a separate 
estimation for the channel rate is made for each of the receivers 18, 19, 32. 
This results in estimated rates Rest.i which represent the channel rate that 
would be available to send data to a client if this client would have the channel 
for 100% of the time. Rest.i can be considered as a measure of the channel 
efficiency, i.e. the ratio of the number of data bits successfully converged to 
the number of data and error bits sent, including retransmitted data frames. 

Equations (2) and (3) are assumed to hold. However equation (4) does 
not hold since the total rate now depends on the way the different channels 
share the medium (e.g. if a channel with a low rate has the channel for most of 
the time, Rtotal will be relatively low). To take this into account, a parameter 
Ni that denotes the part of the time a certain channel has access to the 
medium is introduced. If, for example, channel I holds 50% of the transmission 
channel, the Ni is 0.5. 

Sum < Ni ) = 1 Equation (8) 

Since the definition of Rest.i assumed that channel I held the channel for 
100% of the time, the individual channel rate Ri is related to Ni and Rest.i as 

Ri = Ni * Rest,.' Equation (9) 

Combining the above equations gives for Ri: 

Ri = Xi / Sum(Xi/Rest,i) Equation (10) 

From which the Q target can be calculated as: 



Q = 1/Sum(Xi/Rest,i) 



Equation (11) 
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Under normal conditions, the embodied system aims to provide a uniform 
picture quality both in time and over each of the receivers 18, 19, 32. However 
under critical conditions it may be decided to shut down completely the service 
on one or more of the receivers in order to still provide an acceptable 
performance on the remaining receivers. The scheduler 26 is arranged to 
monitor continually the transmission rates to the various receivers 18, 19, 32. 
The transmission rate calculation takes into account retransmissions. When it 
is detected that the transmission rate for a channel falls below a threshold, 
transmission of data frames on that channel is ceased. The relevant receiver 
18, 19, 32 then causes an appropriate message to be displayed on its 
television. Data for the ceased channel stored in the relevant buffer at the 
gateway 15 is deleted as the deadline time for it passes. This feature prevents 
one badly positioned (as regards the path to it from the gateway 15) receiver 
from taking an unreasonable share of the channel bandwidth and thus 
negatively affecting the quality of the other channels. The quality of the link is 
subsequently monitored by the sending of test-packets. Transmission on that 
channel is resumed once the transmission rate is determined again to be 
satisfactory, for example by comparing the transmission rate to a threshold. 
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CLAIMS 

1. Apparatus for distributing audio-visual content over at least two 
channels, the total channel rate being unpredictable, the apparatus comprising 

5 a coder and a data buffer for each channel, and a transmission controller 
arranged to control the transmission of data from the buffers and to provide for 
the retransmission of data which is deemed not to have been received 
correctly, the apparatus comprising a joint bit-rate controller arranged to 
control each of the coders to provide data at a rate which is dependent at least 

10 . in part on a data production rate and on a data transmission rate. 

2. Apparatus as claimed in claim 1, in which the coders are 
controlled to provide data at a rate which is dependent in part on the amount of 
data awaiting transmission. 

15 

3. Apparatus as claimed in claim 2, in which the coders are 
controlled to provide data at a rate which is dependent in part on the difference 
between the amount of data awaiting transmission and a target amount. 

20 4. Apparatus as claimed in claim 3, in which the coders are 

controlled to provide data at a rate which is dependent on the difference 
multiplied by a control parameter. 

5. Apparatus as claimed in any preceding claim, in which the joint 
25 bit rate controller is arranged to control each coder to provide data at a rate 

which is dependent in part on the complexity of the signal with which that 
coder is fed. 

6. Apparatus as claimed in any preceding claim, in which the joint 
30 bit rate controller is arranged to control each coder to provide data at a rate 

which is dependent in part on an average data transmission rate and an 
average data production rate. 
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7. Apparatus as claimed in claim 5, in which the joint bit rate 

7~ , arran9ed to oonw *" codere to provide date at 3 *** - 

^ dependent also on an estimated channel rate at a relevant flme in the future. 

8 Apparatus as claimed in claim 6, in which the estimated channel 
rate is calculated from historical channel rate data. 

» » «Jr , C PPara,US ^ C ' aime<1 Pre ° edin9 in Whi * *• joint 

b« rate oon^tor ,s arranged to control a coder to pnpvide data a. a rate which 

- dependent in part on the characteristics of the channel associated with the 

10. Apparatus as claimed in claim 9. in which the joint bit rate 
on.ro er is arranged to contro, the coder to provide date at a rate which 
dependent ,n part on the channel rate o, the channe, associated w*h the 

calcuJed fr A T ratUS " °' a ' med " °' aim 1 °' " Whi ° h * e — h 

calculated from the proportion o, data bits transmitted to the tota. number of 
transmitted units. 

12. Apparatus as claimed in any preceding claim, in which the joint 
it-te controiler is arranged to app,y a contro, signs, to a contro, input of ea h 

coder wh,ch determines diredy the quality of encoding used. 

13. Apparatus as claimed in any of claims 1 to 11. in which the joint 
^•ate oontrolier is arranged to apply a contro, signal to a contm, input of eaTh 
coder wh,ch determines directly the output data rate of the coder. 

transm 14 '- " "* PWCedin ° h which the 

transm,ss,on controller is an earliest deadline first scheduler. 
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15. A method of distributing audio visual content over at least two 
channels, the total channel rate being unpredictable, the method comprising 
providing a coder and a data buffer for each channel, controlling the 
transmission of data from the buffers and controlling the retransmission of data 
which is deemed not to have been received correctly, the method comprising 
controlling each of the coders to provide data at a rate which is dependent at 
least in part on a data production rate and on a data transmission rate. 

16. A method as claimed in claim 15, in which the controlling step 
comprises controlling the coders to provide data at a rate which is dependent 
in part on the amount of data awaiting transmission. 

17. A method as in claim 16, in which the controlling step comprises 
controlling the coders to provide data at a rate which is dependent in part on 
the difference between the amount of data awaiting transmission and a target 
amount. 

18. A method as in claim 17, in which the controlling step comprises 
controlling the coders to provide data at a rate which is dependent on the 
difference multiplied by a control parameter. . 

19. A method as in any of claims 15 to 18, in which the controlling 
-a&p comprises controlling the coders to provide data at a rate which is 

dependent in part on the complexity of the signal with which that coder is fed. 

20. A method as in any of claims 15 to 19, in which the controlling 
step comprises controlling the coders to provide data at a rate which is 
dependent in part on an average data transmission rate and an average data 
production rate. 
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21. A method as In any of claims 15 to- 20, in which the controlling 
step compnses controlling the coders to provide data at a rate which is 
dependent also on an estimated channel rate at a relevant time in the future. 

22. A method as claimed in any of claims 15 to 21 comorisino 
caicuiating the esamaled channe, rate from historical channel rate daT 

23. A method as in any of claims 15 to 22, in which the controlling 
step compnses controlling the coders to provide data at a rate which Is 

dependent in part on the characteristics of the channe, associated with the 
coo sr. 



24. A method as claimed in claim 23, in which the controlling step 
compnses centreing the coders to provide data a. a rate which is dependent 
■n part on the channel rate of the channel associated with the coder. 

25. A method as claimed in claim 24 , comprising caicuiating the 

26. Apparatus for distributing audio-visual content substantially as 
desenbed with reference to and/or as shown in the accompanying drawings 

27. A method of distributing audio-visual content substantially as 
desenbed with reference to the accompanying drawings. " 
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